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ANALYSIS OF CARRIES IN SIGNED DIGIT EXPANSIONS 


CLEMENS HEUBERGER, SARA KROPF, AND HELMUT PRODINGER 


Abstract. The number of positive and negative carries in the addition of two indepen¬ 
dent random signed digit expansions of given length is analyzed asymptotically for the 
(g, fi)-system and the symmetric signed digit expansion. The results include expectation, 
variance, covariance between the positive and negative carries and a central limit theorem. 

Dependencies between the digits require determining suitable transition probabilities to 
obtain equidistribution on all expansions of given length. A general procedure is described 
to obtain such transition probabilities for arbitrary regular languages. 

The number of iterations in von Neumann’s parallel addition method for the sym¬ 
metric signed digit expansion is also analyzed, again including expectation, variance and 
convergence to a double exponential limiting distribution. This analysis is carried out in 
a general framework for sequences of generating functions. 


1. Introduction 

Addition is an essential arithmetic operation in many algorithms. As the efficiency of 
addition is influenced by the number of occurring carries, we asymptotically analyze this 
number, which depends on the base and the digit set of the digit expansion. 

We consider two different types of digit expansions; On the one hand, we investigate 
(g, (i)-expansions, that are extensions of the standard g-ary digit expansion with digit set 
{d,... ,q + d — 1}. With d = 0, this includes the case of the standard g-ary expansion. 
Consecutive digits are independent in this case. On the other hand, the symmetric signed 
digit expansion j6] has an even base g and the redundant digit set {—g/2,... ,g/2}. To 
remove the redundancy, there is a syntactical rule to decide which of the digits —g/2 and 
g/2 is used. This rule introduces dependencies between consecutive digits. 

Two different addition algorithms are investigated. The first one is the standard addition: 
We add two digits starting at the least significant position. If the result is not in the given 
digit set or does not fulhll the syntactical conditions, then a non-zero carry is produced. 
This carry is added to the sum of the two digits at the next position. An example for this 
standard addition of two decimal expansions is given in Table 
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2 14 6 

lo 2i 5i 5o 

3 4 0 1 

Table 1. Example for standard addition in the decimal system. The sub¬ 
scripts in the second row are the carries. 


5377 

first summand 

8125 

second summand 

3492 

first interim result 

10010 

carries 

13402 

second interim result 

000100 

carries 

013502 

final result 


0000000 

Table 2. Example for von Neumann’s addition in the decimal system. 


In the case of positive and negative digits, positive and negative carries occur. The 
parameters of interest is their number for an independent pair of random summands of 
given length. 

In contrast to standard addition, von Neumann’s addition is a parallel algorithm with 
several iterations. The idea is to add the digits at each position in parallel (the interim 
result). If this result is not admissible in the given digit system, then a non-zero carry is 
produced and the interim result is corrected correspondingly at this position. However, 
this carry is not added immediately: The interim result and the carries are the input 
for the next iteration. When the carry sequence only contains zeros, then the algorithm 
terminates. An example for von Neumann’s addition is shown in Table for the addition 
of two decimal expansions. 

The number of iterations of von Neumann’s addition is of interest as it corresponds to 
the running time. 

Diaconis and Fulman [1] and Nakano and Sadahiro j9] consider the carries of the standard 
addition as a Markov chain. This is only valid if the digits of the digit expansion are 
independent. In their analysis, they obtain a stationary distribution. In this article, we 
determine the expectation, variance and central limit theorem for the number of positive 
and negative carries as well as the covariance between the positive and negative carries in 
the (g, (i)-system and the symmetric signed digit system. The authors of [1] concentrate 
on an odd basis q and the symmetric digit set { —(g — l)/2,..., (g — l)/2}. The symmetric 
signed digit expansion (defined later) is the natural way to define a unique representation 
with a symmetric set of digits and an even base g. Thus, a part of the present paper can 
be seen as a complement of [T]. 
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The expected number of iterations of von Neumann’s addition was analyzed in [S] and 
[7] for standard g-ary expansions and (g, d)-expansions, respectively. It turns out that the 
expected number of iterations is logarithmic in the length of the expansions. In [7j, sym¬ 
metric signed digit expansions are analyzed, too, but with a simplihed probabilistic model 
since a precise probabilistic model exceeded computing resources available at that time. 
This simplihcation has a signihcant influence on the main term. In this paper, we combine 
advances in soft- and hardware with sophisticated use of the hnite state machine package 
of SageMath [13] to tackle the precise model in roughly 10 minutes of CPU time. The 
results include expectation, variance and convergence to a double exponential distribution. 

The outline of the paper is as follows. In Section we dehne (g, d)-expansions and sym¬ 
metric signed digit expansions. We hrst analyze the standard addition in Sections [3]-[^ The 
algorithms and the corresponding transducers for the standard addition of (g, (i)-expansions 
and symmetric signed digit expansions are presented in Section]^ Our probabilistic model 
is to choose both summands of length £ independently such that each expansion of length 
£ is equally likely. In the case of the symmetric signed digit expansions, the dependen¬ 
cies between the digits require approximating the equidistribution with an error that does 
not influence the hnal result. The corresponding probabilities are defined in Lemma 4.1 
in Section for general regular languages, see also [H] and nn. In Section we com¬ 
bine this approximate equidistribution with the transducers from Section 3.2 to obtain an 
asymptotic analysis including the expectation, the variance and asymptotic normality in 
the main Theorems and for the (g, (i)-system and the symmetric signed digit system, 
respectively. 

Then, we analyze von Neumann’s addition. We start in Section with the algorithms 
and the automaton. Theorem provides a general framework for the analysis of sequences 
occurring in this context. Then we again use the approximate equidistribution from Sec¬ 
tion 1^ to asymptotically analyze the number of iterations of von Neumann’s addition in 
Theorem in Section This analysis extends the results in |B] and [7] to the symmetric 
signed digit expansions and to include not only the expected value but also the variance 
and a convergence in distribution. 

Obtaining the values of the constants occuring in the asymptotic analysis of standard 
and von Neumann’s addition requires computations involving hnite state machines and 
determinants of matrices in several variables. These computations are performed using the 
mathematical software system SageMath [T3|. Notebooks containing all the computations 
can be found at j^. However, the existence of these constants follows from the theoretical 
results. 


2. Digit Expansions 

In this section, we dehne the digit expansions which will be used in later sections. We 
also recall their properties. 


2.1. (g, (i)-expansions. 
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Definition 2 . 1 . Let —q < d < 0 be two integers with q > 2. The (g, h)-expansion of an 
integer x is the g-ary expansion ... Xo)g with digits Xj G {d,q + d — 1} such that 
X = 2^i=oXiq'- 

Example 2.2. The (4, —l)-expansion of 3 is ( 11 ) 4 , where we write I for the digit —1. 

The (g, d)-expansion exists for all integers if d 7 ^ 0 and d 7 ^ —g + 1. For d = 0 (this 
is the standard g-ary expansion), only the non-negative integers have a (g, d)-expansion. 
Conversely, for d = —g - 1 - 1, only the non-positive integers have a (g, d)-expansion. If the 
(g, d)-expansion of an integer exists, then it is unique up to leading zeros. 

If g is odd and d = then the (g, d)-expansion minimizes the sum of absolute values 
of the digits among all g-ary expansions with arbitrary digits (see jB]). 

2.2. Symmetric Signed Digit Expansion. We recall the definition of the symmetric 
signed digit expansion (SSDE) as defined in j6] and further analyzed in [7j. 

Definition 2 . 3 . Let g > 2 be an even integer. The symmetric signed digit expansion 
(SSDE) of an integer is the g-ary digit expansion (x^... Xo)q with Xj G { — 2 ,..., such 
that the syntactical rule 

|xj| = I ^ 0 < sgn(xj)xj+i < I - 1 

is satisfied for 0 < j < £. 

In [6], it is shown that each integer n has a unique SSDE (up to leading zeros). It 
minimizes the sum of absolute values of the digits among all g-ary expansions of n with 
arbitrary digits (cf. [6]). 

For g = 2, we obtain the digit set {0, ±1} and the syntactical rule that at least one of 
any two adjacent digits is zero. This digit expansion is also called non-adjacent form (cf. 

my 


3 . Standard Addition 

We write bold face letters for sequences which are padded with zeros on the left. 

Let X = ... XiXo and y = ... yii/o be the two summands given as g-ary expansions with 
digit set D (possibly satisfying some syntactical rules). Then standard addition can be 
written in the form 

Xi Xo 

• • • C2 Ulc^ UOcn 

Zi Zq 

where Xi + yt + Ci = z* —gcj+i, cq = 0 with Zi E D and 2 = ... ziZq satisfying the syntactical 
rules of the digit system under consideration. We asymptotically analyze the sequence of 
carries c = ... C2C1. 

From a different point of view, the standard addition with digit set D is a conversion 
between different digit sets: We have a g-ary digit expansion with digits in D + D and we 
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12 3 1 
li 2o Ij Ip 
3 13 3 

Table 3. Example for standard addition for (5, — l)-expansions. The sub¬ 
scripts in the second row are the carries. 


want to transform this digit expansion into a digit expansion with digit set D satisfying 
all syntactical rules. This can be written in the form 

... C2 ■^Ici '^Ocq 

Zo 

where Sj = Xi + yt G D + D. We call the sequence s the digitwise sum of x and y and 
write s = X + y. 

We will mostly use this point of view. Most of the algorithms and transducers require 
the input of s. If there are syntactical rules for x and y, then the sequence s can not be 
arbitrary. 

Remark 3.1. From this point of view, it is clear that interchanging two digits Xi and yi of 
the two summands does not influence the result, but only both summands. The carries, 
the digitwise sum and the steps taken by the algorithms and the transducers stay the same 
as they depend only on the digitwise sum. 

3.1. Algorithms. 

3.1.1. Standard Addition for {q,d)-expansions. The digit set is D = {d,... ,q + d — 1}. 
Algorithm transforms a g-ary expansion with digit set D + D into a (g, (i)-expansion. As 
there are no syntactical rules, all digits are independent. Thus, we do not have to look 
ahead when choosing the carry. 

An example of standard addition for (5, — l)-expansions using this algorithm is given in 
Table [H 

3.1.2. Standard Addition for SSDEs. Let g > 2 be even. Algorithm transforms a g-ary 
expansion with digit set {—g, • • •, g} into a SSDE. As the choice between the redundant 
digits ^ and — ^ depends on the next digit, we have to look ahead at the next digit in these 
cases. This algorithm is an extension of the one in [7] taking into account that we start 
with a larger digit set. 

An example of standard addition for SSDEs with g = 4 using this algorithm is given in 
Table H 

3.2. Transducers. In this section, we present the transducers for the algorithms presented 
in the last section. 

We are not interested in the output of the addition, but only in the carries. Thus we 
only use the carries as the output of the transducer. But, if required, the output digits can 
easily be reconstructed. 
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Algorithm 1 Standard addition for two [q, (i)-expansions 

Input: digit expansion {se... so)q with digits in {2d,... ,2q + 2d — 2} 
Output: (g, (i)-expansion z of {s£ ... so)q 

^ = 0 
c = 0 

for j = 0 to £ do 

Q = S j C 

c = 0 

if a > q + d then 

c = 1 

else if a < d — 1 then 
c = —1 
end if 

a = a — cq 
z = {a) + z 

end for 


110 2 
Iq li li 2o 
2 I 2 0 

Table 4. Example for standard addition for SSDEs for g = 4. The snb- 
scripts in the second row are the carries. 


In onr setting, a transdncer consists of a hnite set of states S, a hnite inpnt alphabet 
D + D, an ontpnt alphabet, a set of transitions E ^ S'^ x [D + D) with inpnt labels in 
D + D, ontpnt labels in the ontpnt alphabet for each transition, and an initial state. All 
states are final. 

The inpnt of the transdncer is a digit expansion with digits in D + D. The ontpnt of the 
transdncer is the seqnence of labels of a path starting in the initial state with the given 
inpnt as the inpnt label. In onr cases, there exists always snch a path and it is nniqne (i.e., 
the transdncer is complete and deterministic). 

The labels of the states encode the cnrrent carry (except for the sitnations when we 
have to look ahead). The nnmber of states is independent of g. The nnmber of transitions 
between two states depends on the base g. 

To plot the transdncer, we gronp these transitions and their labels. We draw only one 
arc and write the label M \ c for a set M G D + D to represent a gronp of transitions 
consisting of one transition with inpnt label m and ontpnt label c for every m G M. If M 
is the empty set, then there are no snch transitions. This may happen for special valnes 
of d or g. 
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Algorithm 2 Standard addition for two SSDEs 

Input: digit expansion (s£ ... so)g with digits in {—q, ■ ■ ■ ,q} 
Output: SSDE z of (s£... so)g 

S£+l = 0 

^ = 0 
c = 0 

for j = 0 to £ do 
a = Sj + c 
c = 0 

if a > I then 

c = 1 

else if a < — I then 
c = —1 

else if a = I and ^ ^ 'Sj+i < 0 or 2 < < q) then 

c = 1 

else if a = — I and {—q < Sj+i < — ^ or 0 < Sj+i < |) then 
c = —1 
end if 
a = a — cq 
z = (a) + z 
end for 


The ontpnt label of a transition is one carry c, a pair of carries c, or no carry c, i.e., c G 
{0,1,1, —} U {0,1,1}^, where ” denotes the empty ontpnt. The inpnt of the transdncer 
is the seqnence s of digitwise snms. 

Let i and u be the minimnm and the maximnm of the extended digit set D + D. For 
the labels of the transitions, we define 

M + e= {{m + e \ m e M} U {M n {i, u})) (1 {D + D) 

for c = ±1 and a set M. This definition is motivated by the following interpretation: 
Whenever a set M = {j,..., n} occnrs, it is actnally meant to be the interval [j, oo) 
intersected with the extended digit set. Snbtracting 1 leads to [j — 1, oo), again intersected 
with the extended digit set. This corresponds to M — 1 as defined above. 

3.2.1. Standard Addition for (q, d)-expansions. The transdncer in Fignre compntes the 
carries as in Algorithm We nse the sets L = {2d,... ,d — l}, D = [d,..., q + d — 1} and 
H = {q d,... ,2q 2d — 2}. 

The transitions are constrncted by nsing Algorithm for the cnrrent inpnt and carry. 

3.2.2. Standard Addition for SSDEs. The transdncer in Fignrej^compntes the carries as in 
Algorithm]^ We nse the sets L = {0,..., | — 1}, H = {| + 1, • • •, O'} and TTg = {|,..., q—1}. 

The transitions are constrncted by nsing Algorithm for the cnrrent inpnt and carry. 
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H -111 



Figure 1. Standard addition for two {q, (i)-expansions. 


The labels of the states —1,0 and 1 encode the cnrrent carry. In the states with labels 
±2, we do not know yet whether the digit of the snni shonld be | or — | and thns, which 
carry is prodnced. To decide this, we have to look at the next digit. Thns, the transitions 
leading to a state ±| have no ontpnt (—) and the transitions starting at a state ±| have 
two ontpnt digits. 


4. Approximate Equidistribution 


As a probabilistic inpnt model, we want to nse an eqnidistribntion on all digit expan¬ 
sions satisfying certain syntactical rnles. This is easy in the case of (g, (i)-expansions (see 
Section 4.1) because there are no syntactical rules. But in the case of a general regular 


language, like the SSDE, we can only approximate an equidistribution by Lemma EH 
However, this approximation does not influence the main terms of the results. 

A regular language is recognized by an automaton. An automaton is dehned to consist 
of states, transitions between these states with labels, an initial state and final states. So to 
say, it is a transducer without output. The automaton recognizes a word from a language, 
if there exists a path starting at the initial state, leading to a hnal state with this word as 
the label. 

We call an automaton aperiodic if its underlying directed graph is aperiodic, i.e., the 
greatest common divisor of all lengths of directed cycles of the graph is 1. If the underlying 
directed graph is strongly connected, then the automaton is so, too. If an automaton is 
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H -l\l 



Figure 2. Standard addition for two SSDEs. 


strongly connected and aperiodic, then the adjacency matrix of the nnderlying graph is 
primitive. 

Given an antomaton A for a regnlar langnage, we antomatically constrnct transition 
probabilities between the states to obtain an approximate eqnidistribntion on all words 
of given length The weight of the word is the prodnct of the transition probabilities 
mnltiplied with an exit weight (the factor in front of the prodnct in ([^ below). This 
corresponds to an approximate eqnidistribntion on all paths of length £ of the nnder¬ 
lying graph of the antomaton starting in the initial state. Withont the exit weights, 
these transition probabilities are the same as dehned by Shannon in na and Parry in 
im. We implemented the compntations of this lemma as part of SageMath ra as 
Automaton.shannon_parry_markov_chain. 
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Lemma 4.1. Let A he a deterministic automaton with set of states {1,..., it,}, initial state 
1, final states 0 7 ^ F C {1,..., n} recognizing a regular language C. We assume that the 
adjacency matrix A of the underlying graph of A is primitive. 

The dominant eigenvalue of A is denoted by X, all other eigenvalues of A are assumed 
to he of modulus less than or egual to fX for some 0 < ^ < 1. If there are eigenvalues 
of modulus fX, then each of them must be semisimple, i.e., its algebraic and geometric 
multiplicities coincide. 

Let w > 0 and u > t) he right and left eigenvectors of A for the eigenvalue X, respectively, 
such that = 1 and {u,w) = 1 . 

For a transition t from some state i to some state j, we set 


( 1 ) 


Pt = 


WiX' 


For i > Q, the set of words of C of length I is denoted by Ci. For a word x G Ci, we 
denote the states and transitions used when A reads x by 1 = sq, ..., se and ti, ..., tg, 
respectively. The weight Wfix) of x is then defined to he 


( 2 ) 


Wfix) 


1 

Ws^ (u^ep) 


i 


W’h 


where ep is the indicator vector of the set F of final states. 

Then 

( 3 ) pt = I 

t leaves i 

holds for all states i and 

( 4 ) w,(x) = ^(1 + 0 (e')) 

holds uniformly for £ > 0 and x G 

Furthermore, consider the time-homogeneous Markov chain M. on the state space {1,..., 
n} where the transition probability from state i to state j is 'YhtPt '^here the sum runs over 
all transitions in A from i to j. Then this Markov chain has the stationary distribution 


( 5 ) 


("UlWi, . . . , UjiWji). 


For large i and a transition t from some state i to some state j, pt can be thought as 
the probability of using t under the condition that the automaton is currently in state i. 
Note that the sum in ([^ runs over all transitions leaving i such that multiple transitions 
between i and j are counted separately although their individual weights pt only depend on 
i and j. It turns out that the exit weights do not influence the main term of our asymptotic 
expressions. 

Proof of Lemma We first note that the cardinality \C(\ is given by 

\C,\ = elA^ep = {e,,w){u,ep)X%l + 0{e)) = {u,ep)X%l + 0{e)) 
where ei = ( 1 , 0 ,..., 0 ). 
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For X ^ Li with associated sequence of states (sq, ..., s^), we have 

1 T-r Ws, 1 


We{x) = 


n 


{u, ep) A Wso {u, cf) A^ ■ 


As WsQ =wi = l, we get (|4]). 

Next, we prove ^ by rewriting the sum 


as 


Pt = Y,a,j 

t leaves i j=l 


WiX 


= 1 


by dehnition of w. 

Finally, the transition matrix of the Markov chain Ad is 


P= iai,^ 


WiX / 

by dehnition of the Markov chain and ([^. Thus 

P= ydiagf—A diag(u;i, 
A \Wi Wn/ 


,Wn). 


As 


{UiWi, . . .,UnWn)P = -(«!, . . . , «„) A diag(Wi, ...,Wn) 
= (ui, ...,Un) diag(M;i, ...,Wn) 
('Ul'UIi, . . . , U-nWri)', 


{uiWi,... UnWn) is a left eigenvector of P to the eigenvalue 1. By dehnition of u and w, 
^”^1 MjtCj = 1. As Ad is aperiodic and irreducible, {uiWi,... ,UnWn) is the unique left 
eigenvector with this property and therefore the stationary distribution. □ 


The weight induces a measure on the words of length 1. The total measure of all 
words of length £ is 1 up to an exponentially small error, thus it is a probability measure 
up to an exponentially small error. Each word has exactly the same weight. If we see the 
transition probabilities as a part of the automaton, we obtain a probabilistic automaton: 

Definition 4.2. A probabilistic automaton is an automaton together with a map p: t ^ pt 
from the set of transitions to the interval [0,1] such that 

Y, pt = I 

t leaves s 

holds for all states s. We call pt the weight or the probability of the transition t. 
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Figure 3. Automaton recognizing (g, c?)-expansions. 


4.1. Weights for (g, (i)-expansions. We can use Lemma 4.1 in this case, too, but the 


digits of a (g, d)-expansion are independent of each other because there are no syntactical 
rules involving more than one digit. Therefore we can directly obtain equidistribution, 
not only approximating it. We first describe the direct way and later, in Remark 4^, we 

The exit weight is 1. By 


consider using Lemma [4T 
For any digit Xq 
independence, we have the weight 


G H, we use the weights Wi^Xq) = A 


Weix) = 


for a digit expansion x of length £. With this weight, we have an equidistribution of all 
(g, (i)-expansions of length £. 


Remark 4.3. The same weights can be obtained by Lemma 4.1 The transition probabilities 


^-1 


are po-s>o = Q As the automaton recognizing (g, (i)-expansions has only one state (see 


Figure]^, there is no error term in (|^. 


4.2. Weights for SSDEs. The automaton in Figure [^recognizes SSDEs. The adjacency 
matrix of this automaton is 

/O I 0^ 

A= \ l g-1 1 

Vo I 0, 

where the states are ordered by their labels. 

The matrix A has the eigenvalues g, —1 and 0. The vectors (^, and (|, 1, ^)''' 

are the left and right eigenvector corresponding to the eigenvalue g, respectively. The 
transition probabilities are 

- - 2 _ _ 1 _ 1 

(6) V-l^O — Vl^O — Po-s-l — P0-s>-l — 7^) Po-s>o — “• 

g 2g g 

The constant in the error term is ^ = A The exit weights are (2,1, 2) ■ 

With these transition probabilities, the asymptotic frequencies of the digits (cf. jHI) can 
be computed as 


( 7 ) 


2(9+1) 

9(<?+l) 

1 


if the digit is ± |, 
if the digit is 0, 
otherwise 


by using the stationary distribution given in (j^. 
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2 

2 


+ 1 ,. . . , 


1 





Figure 4. Automaton recognizing SSDEs. 


5. Asymptotic Analysis of the Standard Addition 

In this section, we use the probabilistic model dehned in Section]^ for the input sequence 

Then we will use Lemma |5.1| to obtain expectation, 


of the transducers in Section 3.2 


variance and asymptotic normality of the number of carries. 

In Sections 5A and 5.2[ we will construct probabilistic automata whose transition la¬ 
bels are the carries and where each transition has a weight corresponding to the weight 
constructed in Section HI 

Let m and n be two functions mapping the output of a transition into the real numbers; 
for brevity we write m{t) and n{t) without mentioning the output label of the transition 
t. In our setting m will count the number of carries 1, and n the number of carries —1 of 
the output of a transition. We consider the two random variables and which are 
the sum of the values of m and n, respectively, over a path of length ^ with probability the 
product of the weights of this path multiplied with the exit weight. 

We will use multivariate generating functions in three variables x, y and 2 ;. The variables 
X and y mark the number of carries 1 and —1, respectively, and the variable ^ marks the 
length of the expansion. 

The transition matrix A(x, y) of a probabilistic automaton with K states and two func¬ 
tions m and n is a K x K matrix whose (i, j)-th entry is 


t: i^j 

where pt is the weight of the transition t. 

The next lemma is a slight modihcation of [H Theorem 3.9] taking into account the 
non-uniform distribution of the input alphabet. 

Lemma 5.1. Let A be a strongly connected, aperiodic probabilistic automaton where all 
states are final. Let m and n be functions mapping the output of a transition into the real 
numbers and A{x,y) be the associated transition matrix of the automaton, where x and y 
mark m and n, respectively. Let Mi and Ni be the associated random variables as defined 
above. 
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Define the function f{x,y,z) = det(/ — zA{x,y)). Then the expected value of 
is (cm, en)i + 0{1) with 


Cm — 


e = ^ 

p 

Jz 


(Ll,l) 


(LLl) 


The variance-covariance matrix + 0{T) has the entries 


( 8 ) 

(9) 

( 10 ) 


Pm 


V 


n 


fxifzz + fz) + fzifxx + fx) — “^fxfzfxz 

Pz 

fyifzz + fz) + fzifyy + fy) “ ‘^fyfzfyz 

P 


C = 


fxfyifzz + fz) + Pfxy “ fyfzfxz “ fxfzf. 


yz 


P 


( 1 , 1 , 1 ) ’ 


( 1 , 1 , 1 ) 


( 1 , 1 , 1 ) 


Furthermore, if Vm and Vn are non-zero, then Mg and are asymptotically normally 
distributed, respectively. If the variance-covariance matrix is non-singular, then Mg and 
Ng are asymptotically jointly normally distributed. 


Proof. The moment generating function is 

Eexp(siM£ + S2Ng) = [z^]e~l (/ — zA{e^^ ,e^'^))~^WF 

where ei is a unit vector with a 1 at the position of the initial state and the entries oi wp 
are the exit weights of the states. Since the automaton is probabilistic and aperiodic, the 
unique dominant eigenvalue of A{1, 1) is 1. Thus the same arguments apply as in |5] after 
replacing “complete” by “probabilistic”. We obtain the same formulas for the constants of 
the expectation, the variance and the covariance. Also the central limit theorem follows. 

□ 


5.1. Standard Addition for (g, (i)-expansions. To construct the probabilistic automa¬ 
ton, we start with the transducer in Figure and use the weights from Section 4.1 

All steps in this section, including the computation of the constants in Theorem ^ can 
be done in the mathematical software system SageMath |13| by using the included finite 
state machine package described in j3]. The corresponding SageMath file is available at 
0 


The construction in this section is more general than needed for the case of independent 
digits as in (g, (i)-expansions. But discussing it here in full generality allows reusing the 
same ideas for the case of dependent digits as in SSDEs later on. We will use the same 
construction for SSDEs in Sections 15.21 and iTl 
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In this section, let A be the automaton in Figure 


equipped with the weight - for 


every transition and the exit weight 1 for every state (by Section 4.1). Construct A^ as 
the additive Cartesian of A with itself by the following rules: 


• The states of A^ are pairs of states of A. 

• There is a transition from (a, b) to (c, d) with label x+ym. A? if there are transitions 
from a to c with label x and b to d with label y in A. 

• The weight of a transition in A‘^ is the product of the weights of the two transitions 
in A. 

• The exit weight of a state in A"^ is the product of the exit weights of the two states 

in A. 


The probabilistic automaton A"^ recognizes all possible sequences s of digitwise sums with 
the correct weights for the equidistribution on the independent {q, (i)-expansions x and y. 

In this section, let B be the transducer in Figure [^performing the standard addition of 
two (g, (i)-expansions. Next, we construct S(^g^d) as the composition BoA^hy the following 
rules: 


• The states of S(^q^d) are pairs of states of B and A^. 

• For each pair of transitions from a to c with input label s and output label k in B 
and from b to d with weight w and label s in there is a transition from (a, b) 
to (c, d) with weight w and label k in S(^q^d)- 

• The exit weight of a state in S(^q d) is the exit weight of the corresponding state in 

A\ 


The probabilistic automaton S(^q^d) recognizes the sequence of carries c with the correct 
weights for the equidistribution on the independent (g, (i)-expansions x and y. The prob¬ 
abilistic automaton Sf^q^d) has three states. 

To determine the transition matrix of S(^q^d), we use the following lemma to compute the 
number of transitions between two states. The lemma is proved by an inclusion-exclusion 
argument. 


Lemma 5.2. Let 


-^(^miri) ^max) 2/min) 2/max) "Smin) "Smax) 

|{(^) y') ^ ^ I ^min Cl X Cl ^max) l/min ^ V ^ 2/max: '^min Cx + y < 

'^maxj' I • 


Then we have 


-^(Tmiri! Tfnaxj 2/min) ?/max5 ■Smax) 


A^(0, CX), 0, CX), 0, Smax ^min ?/min) 

A^(0, CX), 0, CX), 0, Smax Tmin I/max 1) 

A^(0, CX), 0, CX), 0, Smax Tmax 2/min 1) 

-|- A^(0, CX, 0, CX, 0, Smax Tmax 2/max 2) 


^This can also be seen as the composition of a transducer performing digitwise addition (without consid¬ 
ering any carries) and the Cartesian product of A with itself. This corresponds to the SageMath methods 
trcinsducers. add and Trcinsducer. cartesian_product, respectively. The composition can be computed 
by the SageMath method Transducer. composition 
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A^(0, OO, 0, CXD, 0, Sjuin ^rain 2/min 1) 
-|- iV(0, CX), 0, CX), 0, Smin ^min I/max 2) 

-|- A^(0, OO, 0, OO, 0, Sjnin ^max 1/min 2) 

A^(0, CXD, 0, CXD, 0, Smin 3^max 2/max 3) 

with N{0, OO, 0, OO, 0, Smax) = 0 z/ Smax is negative and 

A^(0, OO, 0, OO, 0, Sjnax) (Smax 2) (Smax "i" 1) 


otherwise. 


This gives the transition matrix in Table in the appendix where x marks carries 1 and 
y marks carries —1. For example, the entry in the first row and colnmn is 

— -— —y= ^ po^oPo^oy = \N{d,q + d-l,d,q + d-l,2d,d)y 

x+yGL+l 

becanse this entry corresponds to the transitions from —1 to —1 with inpnt label L + 1 
and ontpnt label 1 in and from (0, 0) to (0, 0) in A'^. 


With the transition matrix, the next theorem follows directly from Lemma 5.1 


Theorem 1. Let Mi and Ni he the number of carries 1 and —1, respectively, when adding 
two independent random {q,d)-expansions of length i. The expected value of {Mi,Ni) is 
(ei, e-l)^ + 0{1) with constants 

_ (q + d-l)^ 

2(g-l)2 ’ 

d^ 

The variance-covariance matrix of {Mi, Ni) is (’if v-i)i + 0{1) with constants 

_{q + d- l)2(g4 _ 2q^d - q^d^ - Aqdf - 2q^ - d^ + 2d + 1) 

4(g-l)5(g + l) 

d‘^{2q'^ — q^df — Aq^ — Qq^d — Aqdf + 4g^ + Qqd — — 4g + 2) 

= A{q-lf{q + l) ’ 

d{q + d — l){q^d + q^d? — q^ + Sq'^d + Aqd"^ + 2g^ — 3qd + d'^ — q — d) 

^ 4(g-l)5(g + l) 

Furthermore, the number of carries 1 and —1 is asymptotically jointly normally distributed 
for d 7 ^ 0, —g + 1. Ford = 0, Mi is asymptotically normally distributed and Ni = 0 because 
the carry —1 does not occur. For d = —q + 1, the same holds with Mi and Ni exchanged. 
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Figure 5. Variances and covariance for (10, (i)-expansions of Theorem 


Remark 5.3. The expected value for carries in the addition of (g, d)-expansions corresponds 
to the result in |2|. There, the authors hnd the stationary distribution 

—— -2q +I - 2qd + 2d - 2d^, {q + d - 1)^) 

2{q - ly 

for the states (—1, 0,1) of the carry process. For d = , this stationary distribution can 

also be found in jT]. 

5.2. Standard Addition for SSDEs. To cope with the dependencies between the digits, 
we have to combine the conditional probabilities of the automaton in Figure with the 
carries computed by the automaton in Figure This is done in the same way as in 
Section 15.11 

All steps in this section, including the computation of the constants in Theorem can 
be done in the mathematical software system SageMath jlS] by using its included hnite 
state machine package described in j3]. The corresponding SageMath hie is available at 

ID- 

In this section, let A be the automaton in Figure [^equipped with the weights in ([^ and 
let B be the transducer in Figure [^performing the standard addition of two SSDEs. 

We hrst construct the additive Cartesian product A?^ recognizing all possible sequences 
s of digitwise sums with the correct weights approximating the equidistribution on two 
independent SSDEs x and y. This probabilistic automaton has 9 states. 

Next, we construct iSssde as the composition BoA^. This probabilistic automaton recog¬ 
nizes the sequence of carries c with the correct weights approximating the equidistribution 
on two independent SSDEs x and y. This gives a transducer with 45 states. 
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Because of symmetries (cf. Remark 3.1), we can simplify 5 ssde such that it has only 14 
stated 


Lemma 5.4. A probabilistic automaton can be simplified by applying the following rules: 

• If between two states, there are two transitions with the same label, then these two 
transitions can be combined. The weights are summed up in this process. 

• Let {Cl,... ,Cfc} be a partition of the states of the automaton with the following 
property: Ifa,bE Cj are two states, then there is a bijection between the transitions 
leaving a and the ones leaving b which preserves the label, the weight of the transition 
and into which set of the partition the transitions lead. These bijections define an 
eguivalence relation on the transitions leaving a set of the partition. 

Then each set of the partition can be contracted to a new state. For each eguiv¬ 
alence class of transitions, there is one transition in the simplified transducer. 


Thus, we obtain a 14 x 14 transition matrix of 5 ssde given in Table in the appendix 
(using Lemma 5.2). 


Theorem 2. The expected value of the number of carries egual to 1 when adding two 
SSDEs of length I is 


+ 2g + 4 
8(g + l)2 


i + 0{l) 


and the variance is 


7g6 ^ 43^5 ^ ^59^4 ^ - 48g2 - 12g - 8 

64(g + l)5(g - 1) 




The same result holds for carries equal to —1. The covariance between carries 1 and — 1 
is 


qS + 2Aq^ + 33q^ + 80^^ + 120^^ - 12g - 8 
64(g + l)5(g-l) 


e + o{i). 


The number of carries 1 and —1 is asymptotically jointly normally distributed. 


Proof. We can compute the determinant f{x,y,z) = det(/ — zA{x,y)) of the transition 
matrix A{x,y) in the appendix of the simplihed automaton iSssde with 14 states. Thus, 
Lemma |5.1| implies the expected value, the variance and the central limit theorem where 
the input sequence is the sum of two independent SSDEs of length i with the approximate 
equidistribution W^. 

As the (exact) equidistribution satishes P^ = (1 + 0{f^))W£, these results also hold 
for the (exact) equidistribution. □ 


^For the actual computation, it is more efficient to already simplify by the SageMath method 
FiniteStateMachine .markov_chain_simplif ication, such that it only has 6 states. 
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Figure 6. Variance and covariance for SSDEs for q = 2, ..., 100 of Theorem 

Remark 5.5. If we neglect the dependencies between two adjacent digits, we obtain a 
different result; Assume that the digits are independently distributed with probabilities 
given in Q. Then the expected value of the number of carries 1 is 

qi2 ^ 7^11 ^ 79^10 ^ 27q^ + 2V + W - - 15g® + 47g^ + lOdg^ + 64g2 - 48g - 48 

8{q + _|_ 4g6 _|_ 5^5 — q^ — 9g3 _ 3^2 _j_ 4^ 

and the variance is 

^(7q^^ + 152g^^ + 1557q^^ + 9958q^^ + 44300g^^ + 144166g^^ + 349511^^^ 

64 

+ 622942g3^ + 756995g^° + 432788^^^ - 439628^^® - 1347486^^7 _ 1407649^^® 

- 466340g2® - 39181g^^ - 2293904g23 _ 6902413^^2 - 9055044g2i - 2972395^2° 

+ 10157788g^^ + 19040707g^® + 12034998g^^ - 7655356g^® - 21471482g^® 

- 15688011g^^ + 1495584^^^ + 10611092g^2 ^ 5752536^^^ - 1482784g^° 

- 1794016g^ + 1000784g® + 744768g^ - 1199872g® - 1204224g® + 120832g^ 

+ 574464g3 + 172032g2 - 73728g - 36864) 

X q~^(q + l)“®(g'^ + 4g® + 5g® — q^ — 9q^ — 8q^ + 4)“^ 

X (g^ + 2g® + g® + - 2q^ + 4)“^ 

As expected, the limit for g to infinity is the same. 

6. Von Neumann’s Addition 

In this section, we analyze von Neumann’s addition algorithm for SSDEs, a parallel 
algorithm using several iterations. This algorithm was analyzed by Knuth in [8] for stan¬ 
dard g-ary expansions. In [7], this analysis was extended to (g, (i)-expansions and SSDEs. 
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q,...,2q-2 0, 



Figure 7. Automaton to find the longest carry generating sequence for von 
Neumann’s addition of two standard g-ary expansions. 


( 11012)4 = x = = 314 

( 10112)4 = y = = 266 

( 21120)4 = = 600 

(000110)4 = = -20 

( 021010)4 = = 580 

(0000000)4 = c(2) = 0 

Table 5. Example for von Neumann’s addition for SSDEs with g = 4. We 
have f(11012,10112) = 2. 


However, for g > 4, the hardware and software available at that time made the use of the 
probabilistic model of Section 4^ computationally infeasible. The approximate model de¬ 
scribed in Remark 5A was used instead. As Remark 5A demonstrates, this approximation 
may lead to different main terms in the expectation and the variance. 

As before, we choose an approximate equidistribution for all independent pairs of SSDEs 
of length i as our probabilistic input model. In contrast to the result in j^, we obtain more 
natural constants occurring in the main term of the expectation and the variance. 

For von Neumann’s addition of two standard g-ary digit expansions, the number of 
iterations depends on the longest subsequence (g — 1)... (g — l)j with j > g of the digitwise 
sum s, see |H]. Such sequences can be found by an automaton with two classes of transitions 
(see Figure and [H Figure 1]). One class corresponds to the digit (g — 1) of a carry 
generating sequence and is depicted by solid lines. The other class corresponds to all other 
digits (including the digit j of a carry generating sequence) and is depicted by dotted lines. 
The longest consecutive run of solid edges in the automaton in Figure corresponds to 
the number of iterations of von Neumann’s addition minus 2. The asymptotic analysis of 
these longest runs can be performed using the probabilistic version of the automaton in 
Figure We will extend this approach to SSDEs with arbitrary even base using a larger 
probabilistic automaton in Section 
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6.1. Algorithm. Let x and y be two SSDEs. The idea of the algorithm is to construct 
the sequence of digitwise sums s = x + y and correct each position if the number at this 
position is not in the digit set or at the border of the digit set where we have to take into 
account the syntactical rule. 

As in [7], we define ( 2 , c) = add(s) with s = x + y hy 

Co = 0, 

if |sj| > 2 , 

or |sj| = I and 
(sgn(sj)sj+i) mod g > | 
otherwise, 

Here, the choice of the carry c^+i corresponds to the one in Algorithm By iterating this 
step we obtain = add( 2 ^^^ + with = x and = y. If = 0, 

then is the SSDE of the sum x + y and the algorithm stops. Note that during this 
process, 2 ^^^ and are not necessarily SSDEs. 

In [7j, the correctness and the termination of this algorithm were proved. We denote 
the number of iterations of von Neumann’s addition algorithm by t{x, y) = min{fc > 0 : 
= 0 }. 

6.2. Automaton. A description of all SSDEs x and y with t{x,y) = k is given in jTj. 
This description is in terms of an automaton and leads to the automaton in [71 Figure 5] 
reproduced here as Figure We use the sets L = {0, ...,g/2 — 1}, Lq = T \ {0}, 
H = {q/2 + 1,..., g} and iLg = if \ {q}. 

From [71 Theorem 3.4], we know that t{x,y) < k + 2 if and only if this automaton 
traverses at most k consecutive solid transitions when reading s. 

Remark 6.1. Strictly speaking, the automaton reads the sequence (sj)j>o where Sj = Xj+yj 
for j < J and sj = 0 for j > J, for some J. However, most of the solid edges are visited 
while j < J. All transitions with label 0 lead to state 1. Those from states 2 and 7 are 
solid edges, all others are dotted. If the transition is in state 2 (or 7) after reading sj, an 
additional solid edge will be traversed. Thus, we have to specially treat the states 2 and 7. 


'sgn(sg 


Cj+i — < 




7. Asymptotic Analysis of von Neumann’s Addition 


For the asymptotic analysis, we combine the automaton in Figurej^with the probabilistic 
model for SSDEs from Section 4^ in the same way as in Section |5.2[ 

All steps in this section, including the computation of the constants in Theorem can 
be done in the mathematical software system SageMath |13j by using the included hnite 
state machine package described in [3]. The corresponding SageMath hie is available at 

II 
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_2 2 

2 2 



Figure 8 . Automaton in j71 Figure 5]; t{x,y) < k + 2 ii and only if the 
automaton traverses at most k solid edges when reading {sj)j>o. 


We again use the automata A and A? described in Section 5^, recognizing SSDEs and 
the digitwise sum of two SSDEs, respectively. As before, the next step is to construct the 
Cartesian product A/ssde of the automaton B in Figure and A^. 

After simplifying this construction as described in Lemma [5^ the probabilistic automa¬ 
ton A/ssde has 12 states: 


{(4,(0,0)),(9,(0,0))}, 
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(11) {(5, (0,1)), (5, (1, 0)), (10, (-1, 0)), (10, (0, -1))}, 

{(2, (0,1)), (2, (1,0)), (7, (-1,0)), (7, (0,-1))}, 
{(5, (0,0)), (10, (0,0))}, 

{(2, (0,0)), (7, (0,0))}, 

{( 1 ,(- 1 , 0 )),( 1 ,( 0 ,-!)),( 1 ,( 0 ,!)),( 1 ,( 1 , 0 ))}, 
{(3, (0,1)), (3, (1, 0)), (8, (-1, 0)), (8, (0, -1))}, 
{( 1 ,( 0 , 0 ))}, 

{(3, (0,0)), (8, (0,0))}, 

{(4, (1,1)), (9, (-1,-1))}, 

{(4, (0,1)), (4, (1,0)), (9, (-1,0)), (9, (0,-1))}. 


In this case, the simplihcation is done in the same way as in Lemma 5.4, but also taking 
into account the class (dotted or solid) of a transition. The partition of the set of states 
was constructed by the symmetries between the two sequences x and y described in Re¬ 
mark [3T1 for example {(1, (—1,1)), (1, (1, —1))}, and the additional vertical symmetry of 


the automaton in Figurefor example {(4,1,1), (9, —1, —1)}. 

The state (1, (0,0)) is initial and all states are hnal. 

The next theorem is an extension of Lemma 2.5 in |7| additionally including the variance 
and convergence in distribution. 


Theorem 3. Let wik, > 0, he non-negative numbers with generating function 


Gk{z) = „ , , = > ^wikZ 


Sk{z) 


£>0 


such that W£k is non-decreasing in k. 
Assume that 


Sk{z) = (1 - z)so{z) + Si(^) + S 2 (^z, , . . . , ) , 


where Tq, Sq? Si are real polynomials in z (not depending on k). Furthermore, ri and 
§2 are real polynomials in z, {z/ai)^, ..., [z/amY some m>2 and some real numbers 
1 < a := Oi < |a 2 | < jasl < • • • < |am| such that each of the summands in ri is divisible by 
one of the terms {z/ai)^, ..., [z/am)^ and each of the summands in S 2 is divisible by one 
of the terms {z/aiY^, [zja^)^, {z/amY. Define 


6 := Si(l)/so(l), p := min(log|a2|/logai,2) - 1. 


Assume furthermore that ro(l) ^ 0, that Sq does not have any zero in \z\ < 1 and that 

6 > 0 . 
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Then G{z) := = Mmk^^Gkiz) and 

Giz) = E 


WtZ 


e>o 


with We = wek for k > i. Additionally, we ^ 0 for i > Eq for a suitable Eq. 

Let {Xe)e>ef, be the sequence of random variables with support No defined by 


¥iXe <k) = —. 

We 


( 12 ) 


Then the asymptotic formula 

Wek 


— = exp(-6E/a’^)(l + o(l)) 
We 


holds as E ^ oo for k = \og^E + 0{1). Hence the shifted random variable Xe — log^£ 
converges weakly to a limiting distribution if E runs through a subset of the positive integers 
such that the fractional part {log„ E} of log^ E converges. 

The expected value of Xe is 

f E 

(13) ¥.Xe = log„ E + log„ 5 + --+ - + ^o(loga E + log„ d) + O ' 

log a 2 

the variance is 


(14) VX^= —^^ + ^ + 4^i(log„£ + log„5)--^4^o(loga^ + log„(5) 

6 log a 12 log a 

where 7 is the Euler-Mascheroni constant, and 4/o(a:) and \E'i(a:) are periodic functions 
(with period 1 and mean value Oj, given by the Fourier expansions 


(15) 

d'o(T) 


2n™ 


log a/ 

(16) 

d^i(T) 

- ^ VrY 

2nvri\^2n™ 


log a/ 


Proof. Parts of the proof of this theorem follow along the same lines as the proof of 
Lemma 2.5 in |7j. However, we include all steps of the proof for the sake of readabil¬ 
ity. 

Without loss of generality, we can assume ro(l)/so(l) = 1, as otherwise wek and we are 
multiplied by a constant. Let 0 < fci < ^2 < ^3 denote suitable constants. 

For some G > 0 such that there is no root of sq inside {-2 : |^| < 1 -l- 2G} and such that 
(1 -|- C)/a < 1, we have 

\Sk{z) - (1 - 2 :)so( 2 :)| = 0(^((1 C')/a)^j < 1(1 - ^)’So( 2 :)| 
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for 1^1 = 1 + C and k > ki. By Rouche’s Theorem, we conclude that for k > ki, Sk{z) has 
exactly one simple root in the disk {z : \z\ < 1 + C}. 

Since sgn(S'fc(l)) = sgn(si(l)) and sgn(S'fc(l + l/k)) = — sgn(so(l)) for k > k 2 , the 
assumption 5 > 0 implies that Sk{z) has a real root (k = ^ + £k with 0 < Sk < 1/fc for 
k > k 2 . Inserting this in S'fc(l + Sk) = 0 yields Sk = 0{l/a^). Using Sk{l + £/;) = 0 again 
shows that 

Et = 4(i + o(Cc‘)). 


where min{a, |a 2 |/a} = =: c> 1. 

Since Gk and G are rational functions, Gk and G can be continued analytically be¬ 
yond their dominant singularities (k and 1, respectively. We have hmfc_).oo ReSz= Cfe ^k{z) — 
Res^=i G(z) = 1. Thus [TTl Theorem 1] implies (12) and the limiting distribution. 

The coefficients wek and W£ of z^ in Gk and G, respectively, coincide for k > i. Thus the 
support of Xi is finite. Furthermore, the condition on sq implies that wi = 1 + 0 {k^) for 
a constant 0 < a < 1 by singularity analysis. Thus, the expectation is 


e i 

(17) EX, = A:P(X, = A:) = (l - ^) = ^^(1 - w^k) + 

k>0 k=0 k=0 


Using the residue theorem and the assumption ro(l) = 50(1), we get 


W£k RgS^=0 

2Tn 


Rk{z) 

z^+^Sk{z) 

Rkjz) 

|=l+C/2 Z^^^Skiz) 


Rkjz) 


= + 0((1 + c/2)-') 

= exp(-&/a'^)(l + 0(k/a^) + 0(£k/(aV))) + C>((1 + G/2)-^) 


for k^ < k < n. 

Replacing wik with exp{—i6/a^) yields the error terms 

(0{e-^) for 0 < A: < log„(M/(41og£)), 

(18) \w£k - exp(-£<5/«")l = \ 0{\ogP,-^^i/iP) for log,(£5/(4log£)) < k <5\ogJ, 

[ for 5 log^ i < k < i 

where we used wek < weka for k < k^. As 1 — exp[—l5/a^) is exponentially small for k > i, 
we obtain 


^ ^ /I p+3 

^(1 -TOtt) = J])(l -exp(-«/a‘)) + 0l Zi— 


( 19 ) 
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Thus, (13) follows from (17), (19) and the well known fact (see e.g. m) that 
^ (l - = log„ a; + + ^ + To(log„ x) + 


fc >0 


with the periodic function To(x) given in (15). 
The second moment is 


( 20 ) 


EA'I = ^ k^¥(X, = k)^'^(2k + l)(l- —) 

k>0 k=0 

I 

= y~~^(2fc + 1)(1 — Wik) + 0{£‘^k^). 

k=0 


As ~ already been computed for the expectation, we are left with 

— W£k). We use (18) to obtain 

^ 1 pH-4 

^k(l-w,t) = '^k(l- exp(-«/o‘)) + o( 


( 21 ) 

fc=0 k>0 

The Mellin transform (see m) of the harmonic sum F{x) = J2k>o ~ exp(—x/a^)) is 

for — 1 < 3?s < 0. The singular expansion of this Mellin transform at 3fJs = 0 is 


F*(s) 


1 -3 , 7 


-s"" + 


S"' + ( — 


log^ a log^ a V12 2 log^ a V ' ' 6 


TT 


7 +Tr s 




log a ^ 


n^O 


n^O 


rn-Xn) 

log^ a 


(s + Xn) 


-1 


Xn = ig. Thus, 


F{x) = I log^a: + log„^ “ lA + o, ^2 
2 logo 12 2log a 


TT 


^ +y 


log a 


r(-x„) exp(27rm log„ a:) 


nf^0 


log^ a 


5^r'(-Xn)exp(27rmlog„a;) + C>(x ^). 


nf^0 


Thus, YXe = EX| — (EX^)^, ([20|), (p^, ((T^ and give the variance as stated in 

dTil). □ 
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Theorem 4. Let q >2 be even. Then the expected number of iterations when adding two 
SSDE of length i with von Neumann’s algorithm is 


( 22 ) 

where 
5 = 


logq e. + logg 5 + + - + 4'o(logg e. + logg 5) + ^ log^ tj 

{q - l)(4g^o + lOg^ + 18g® - - lOg^ + Iq^ + AAq^ - 29q^ - 8q^ - 20q + 16) 


4g3(g + l)2(4g'^ — q^ — 6g^ + 8q^ + 2q — A) 

']/o(t) is a 1-periodic function with mean 0 given by the Fourier expansion 

1 


(23) 


>I>i,(i) = 


log q ^ 


log g/ 


The variance of the number of iterations is 

(24) 


TT 
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2 ' io '■^l(logg^ + logg'^)-i-^o(log/ + log 5)-4'o(log £ + log 5) + C>(£ log tj 

61og g 12 ^ ^ logg ^ ^ y y 

where 4/i is a 1-periodic function with mean 0 given by the Fourier expansion 

2 2k'Ki\ 


(25) 


The asymptotic formula 


^i(t) = 




T' 


.^2k'Kix 


logg. 


y) <k) = exp(-5£/g^)(l + o(l)) 

holds as i ^ oo for k = log^^ + 0{1). The random variable t{X,Y) — log^^ converges 
weakly to a double exponential random variable if ^ runs through a subset of the positive 
integers such that the fractional part {log^ i} converges. 

Remark 7.1. A similar result for g > 4 was obtained in [7] using the same probabilistic 
model as in Remark 5.5 This changes the main term of the expected value. In [7], the 


logarithm of the main term was taken to the base a ^ with a = q ^ — q 0{q ®). In 


contrast, we here obtain the logarithm of the main term in (22) to the base g, which is a 
more natural constant appearing in this context. 

For g = 2, this result is contained in j7]. 


Proof. Let be the (exact) equidistribution of all SSDE of length i. For k > i 2, we 
know that F£{t{X,Y) < k) = 1 because an input sequence of length i traverses at most £ 
solid edges in the automaton in Figure 

If we use the approximate equidistribution IL7 = (1 + of all SSDE of length i, 

an exponentially small error term is introduced. Because of the finite support, this error 
term does not change the main term of the expectation, the variance and the distribution 
function. Thus, also the limiting distribution remains the same. 
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We will use Theorem with the generating function 


G,(z) = Y. 


WikZ 


e>o 


for Wik = Wi{t{x,y) — 2 < k), k > 0. To construct this generating function, we use the 
same techniques as in 

The generating function Gk{z) counts the weighted number of paths in the automaton 
A/ssde of the pattern ... ... where B~^ is an arbitrary non-empty sequence 

of dotted transitions and is a non-empty sequence of solid transitions of length at 

most k. The first transition can be a dotted or a solid transition. We stop with either 
arbitrarily many dotted transitions or at most k solid transitions, where we have to take 
into account the special situation in states 2 or 7 in the automaton in Figure (see also 
Remark 6.1): Because of the solid transition starting in 2 and 7 with label 0, we are not 
allowed to stop with k solid transitions in state 2 or 7 but only with at most k — 1 ones. 

To hnd the generating functions for B^ and we use the transition matrices for 

the dotted and the solid parts of the automaton A/ssde- 

Let q > Q. The transition matrix R for the solid transitions of automaton A/ssde is a 
12 X 12 matrix given in Table in the appendix (using Lemma 5.2). The transition matrix 
B for the dotted transitions of automaton Assde is given in Table 10 (using Lemma 5.2). 
The order of the states is given in ( pT| and also in Table in the appendix. 

The (matrix) generating function for arbitrary non-empty dotted paths B~^ is 


B- 


= (I-zB)-^ -I. 


The entry {i,j) of fhis matrix is the generating function of non-empty dotted paths of 
arbitrary length starting in state i and leading to state j. For arbitrary non-empty solid 
paths, the (matrix) generating function is 

R+{z) = (I-zR)-^ -I. 

To obtain the (matrix) generating function for non-empty solid paths of 

length at most fc, we have to restrict each entry of R^ corresponding to an inhnite geometric 
series to a hnite geometric series]^ We will illustrate this procedure on 

-q*z + lOq^z - 3q‘^z^ - 24:q^z + lOqz^ + 8z^ 


(26) 


-8q‘^ + 8q^z — 8q^z + 8qz‘^ 


the entry at position (5,1) of The partial fraction decomposition of (26) with respect 
to 2 ; is 


(3g + 2)(g-^^ (g-4)(g + 4) 


8q 


4:{q + l) l + z/q'^ 


+ 


(g- l)(g-2)(g-4) 
8q{q + 1) 


1 - z/q 


^It is also possible to use = zR + ■ ■ ■ + z’^R^ = (/ — — zR)~^ — I. However, 

this involves a power of the symbolic matrix R with the symbolic exponent k. This would require a full 
symbolic eigenvalue decomposition of R. The approach chosen here avoids this by introducing the length 
restriction on each entry individually. 
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By truncating the infinite geometric sum [1 — z) ^ after k + 1 summands, i.e., by replacing 
it with (1 — — z)~^^ we obtain 

(3g + 2)(g-4) ^ (g-4)(g + 4) l-{-z/q^f+^ ^ (g - l)(g - 2)(g - 4) 1 - {z/qf+^ 
8q 4(^ + 1) l + z/q"^ 8g(g +1) 1 — z/q 


Let 


/ N f 0 B+(z] 

Mk{z) - ( 0 


be the block matrix of total size 24 x 24. Then, the (matrix) generating function of non¬ 
empty paths ... ... is 

To take into account the initial states and the exit weights in the automaton A/ssde, we 
define the initial vector 


u = (0, 0, 0,0, 0, 0, 0,0,1, 0, 0, 0; 0, 0, 0, 0, 0, 0, 0, 0,1, 0, 0, 0). 

Using the exit weights in Table in the appendix, we further define the exit vector 


T 

V = 


(izd ( 4 . 1 . 2 . 0 . 1 . 0 . 2 . 2 . 1 . 1 . 4 . 2 ; 4 . 1 . 2 . 2 . 1 . 1 . 2 . 2 . 1 . 1 . 4 . 2 ) 

g + 1\2 


q + 2 


Mfc_i(z)(0,0, 0, 2, 0,1, 0, 0, 0, 0, 0, 0; 0, 0,0, 0, 0, 0,0, 0, 0, 0,0, 0) 


taking into account the special situation with states 2 and 7 in the automaton in Figure]^ 
Then, the generating function is 

'g + l\2 


Gt{z) = «((/ - J\4(z))-‘ - I)v + (^) 


where we add the exit weight of state (1, (0, 0)) because the empty word was not counted 
until now. The result is 


( 27 ) 

with 


G,(z) = 




ro{z) = Aq\q + 1)^(42;^ - 3q‘^z - q^){2qz^ - 4/ -f- - q^z^ - 6gV -f 4g^), 

So(z) = Aq\q + l)(g + 2f{z + q){z - q^){2qz^ - 4/ + 8q^z^ - q^z"^ - 6q^z‘^ + 4g^), 
si(z) = -{q + z)z^{q + 2)2g^(4g^2 + Qq^^z + 2q^^z^ - Aq^^ - 2Aq^^z 

- 8q^z‘^ + 24g^° + 2Qq^z + Aq^z'^ + - 7g®z^ - 48g® 

- 2Qq^z -1- 18g^z2 - 9q^z^ + Uq^z^ + 5gS® + 32gS + 36g®z2 

- 82q^z^ - 59g^z^ - 2hq^z^ - ll2q^z‘^ + Uq^z^ + AQq^z^ 

+ AAq^z^ + Uq^z"^ - A8q^z^ + Aq^z^ - 36qz^ - 16g/ + 
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and some polynomials ri and S 2 in z, {z/q)^ and {—z/q^)^ with coefficients in Q[q]. The 
polynomial Sq does not have any zeros in the closed unit disc. We have ro(l) 7 ^ 0 and 


h > 0. 


For g < 4, the construction of the generating function Gk{z) is the same, only the 
matrices R and B and the vectors u and v are slightly different. Nevertheless, (27) including 
the definitions of all the occurring polynomials is still valid. 

By Theorem we obtain the expectation, the variance, the distribution function and 
the limiting distribution of the non-negative truncation of t{x, y) — 2. From (18) and the 
monotonicity of Wik, we know that Therefore, the results transfer 

to the random variable t{x, y) as stated in the theorem. □ 
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Appendix A. Transition Matrices 

(- 1 ,( 0 , 0 )) _ ( 0 ,( 0 , 0 )) _ (i,(o,o)) 

{d — l){d — 2)y —2d? — 2dq + + 6(i + 3g — 4 {d + q — l){d + q — 2)x 

{d — l)dy —2d? — 2dq + q'^ + 2d + q {d + q){d + q — l)a; 

{d + l)dy —2d? — 2dq + q^ — 2d — q {d + q + l){d + q)x 

Table 6. Transition matrix of Sf^q^d) in Section |5. 1 1 mnltiplied with 2q^. The 
order of the states is given in the hrst line. 





&q^ -125 + 8 

4 

4(5 - 2)y 

8 

1 

00 

1 

00 

H 

1 

00 

1 

1 

1 

1 

H 

22/ 

2® 

45- 

00 

1 

00 


0 

0 

0 

0 

0 

0 0 

0 0 

0 

0 

0 

0 

6(5- 2)5 

0 

Aqy 

0 

0 

45 

0 0 

2(5 - 2)52/ 0 

0 

0 

85 

0 

2{qy + 25 - 2y)q 

0 

Aqy^ 

0 

0 

Aqy 

0 0 

2(5 - 2)52/2 0 

0 

0 

0 

0 

2(35-2)5 

0 

4(5 - 2)y 

8 

0 

45-8 

8 0 

2{q-2){q-A)y 0 

0 

0 

85 - 

16 0 

2(35-2)5 

0 

0 

8 

45-8 

0 

8 4(5-2)® 

0 2(5-2)(5-4)® 

0 

0 

0 

85- 16 

2{qx + 2q — 2x)q 

0 

0 

0 

Aqx 

0 

0 45®2 

0 2(5 - 2)5®2 

0 

0 

0 

0 

6(5- 2)5 

0 

0 

0 

45 

0 

0 Aqx 

0 2(5 — 2)5® 

0 

0 

0 

85 

6(5- 2)5 

4 

Aqy 

8 

45-16 

45 

8 4(5 - 4)® 

(5-2)52/ (5-4)(5-6)® 

22/ 

2® 

45 

45-16 

6(5- 2)5 

4 

4(5 - A)y 

8 

45 

45- 16 

8 45® 

{q-A){q-6)y (5-2)5® 

22/ 

2® 

45- 

16 45 

1 

to 

0 

0 

0 

0 

0 

0 0 

4(5 - 2)qy 0 

0 

0 

165 

0 

1 

to 

0 

0 

0 

0 

0 

0 0 

0 4(5 — 2)5® 

0 

0 

0 

I65 

{3qy + 35 - 61/ - 2)5 

4 

452/2 

0 

45-8 

Aqy 

0 4(5-2)® 

{<l-‘2)qy^ {q-2){q-4)x 

22/ 

2® 

0 

0 

{3qx + 3q — 6x — 2)q 

4 

4(5 - 2)y 

0 

Aqx 

45-8 

0 45®2 

{q-2){q-4)y {q-2)qx^ 

22/ 

2® 

0 

0 

Table 7. Transition matrix of 

‘SssDE for g > 8 

in Section 5.2 multiplied 

with 8g^. 

The 

order of the 

states 

is 

{(0.(0,0))}, 

{(0,(-l,l)),(0,(l,-l))}, {(-1,(-1,0)),( 

-1,(0,- 

■1))}, 


{(-g/2, (-1, 0)), (-g/2, (0, -1))}, {(0, (-1, 0)), (0, (0, -1))}, {(0, (0,1)), (0, (1, 0))}, 

{(g/2,(0,l)),(g/2,(l,0))}, {(1,(0,1)),(1,(1,0))}, {(-1,(0,0))}, {(1,(0,0))}, 

{(l,(l,l))},{(-g/2,(0,0))},{(g/2,(0,0))}. 


(1,(-1,1)) (4, (0,0)) (5,(0,!)) (2,(0,!)) (5, (0,0)) (2, (0,0)) (1,(-1,0)) (3,(0,!)) (1,(0,0))} (3, (0,0)) (4,(1,!)) (4,(0,!)) 

4 12211 2 2 1 142 

Table 8 . Exit weights of A/ssde in Section 7 multiplied with As discussed in (11 , the states of 

Assde are equivalence classes of states. Fo^revity, we list one representative for each state of A/ssde 
to give the order of the states. 
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0 

0 


0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 


0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 


0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 


0 

0 

0 

0 

0 

0 

4g(g - 2) 

8q 

0 

0 

0 

0 


0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

4 

(g-4)(g- 

6) 

0 

8 

0 

4(g-4) 

4(g-4) 

8 

3g(g - 2) 

4g 

4 

4(g - 4) 

0 

0 


0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

2(g-2)(g- 

-4) 

0 

8 

0 

8(g-2) 

4(g - 2) 

8 

2q{q - 2) 

0 

0 

4(g - 2) 

0 

0 


0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

1 

4) 

0 

8 

0 

4(g-2) 

4(g - 2) 

8 

(3g-4)(g-2) 

4(g-2) 

0 

4(g - 2) 

0 

0 
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0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 


0 

0 

0 

0 

0 

0 

0 

0 

0 

0 


Table 9. Transition matrix R for the solid transitions in A/ssde for O' > 6 in Section [^mnltiplied with 
8 g^. The order of the states is the same as in Table 
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0 


0 


0 

0 

0 


0 


0 

C 

1 8 g 2 

0 


0 

0 


4 

2(g-4)^ 

> 

0 

16 

0 


8 (g- 

3) 

8 (g- 

3) 16 2(3g-2)(g-2) 

8 (g- 

1 ) 

4 

8 (g- 

3) 

0 

2 (g 

- 2 )(<; - 

-4) 

0 

8 

0 


8 (g- 

2 ) 

4(g- 

2 ) 8 

> 2g(3g — 2) 

0 


0 

4(g- 

2 ) 

0 

2 (g 

- 2 )(<; - 

-4) 

0 

8 

0 


8 (g- 

2 ) 

4(g- 

2 ) 8 

! 2 g(g - 2 ) 

0 


0 

4(g- 

2 ) 

4 

2 (g 

- 2)(« - 

-4) 

0 

8 

0 


4(g- 

2 ) 

8 (g- 

2 ) 8 

> 6 g^ — 12 g + 8 

4(g - 

2 ) 

4 

8 (g- 

2 ) 

0 

(?- 

- 2)(« - 

4) 

0 

8 

0 


4(g- 

2 ) 

4(g- 

2 ) 8 

1 

1 

to 

4(g - 

2 ) 

0 

4(g- 

2 ) 

0 

2 (g 

- 2)(« - 

-4) 

16 

0 

8 (g - 

2 ) 

0 


4(g- 

2) C 

1 2g(3g — 2) 

0 


0 

4(g- 

2 ) 

0 


0 


0 

0 

0 


0 


0 

C 

1 4g^ 

0 


0 

0 


4 

2 (g 

- 2 )(<; - 

-4) 

16 

0 

8 (g - 

2 ) 

0 


8 (g- 

2) C 

1 6 g^ — 12 g + 8 

0 


4 

8{q- 

2 ) 

4 

(?- 

-2)(q- 

4) 

0 

0 

0 


0 


4(g- 

2) C 

1 g(3g -2) 

0 


4 

4(g- 

2 ) 

0 

4(g 

- 2 )(<; - 

-4) 

0 

0 

0 


16(g- 

- 2 ) 

0 

C 

1 4g(g - 2) 

16g 


0 

0 


0 

2 (g 

- 2 )(« - 

-4) 

0 

8 

0 


8 (g- 

2 ) 

4(g- 

2 ) 8 z 6 (g- 2 )g 

8q 


0 

4(g- 

2 ) 


Table 10. Transition matrix B for the dotted transitions in Assde for g > 6 in Section [^multiplied 
with 8g^. The order of the states is the same as in Table 
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